Display apparatus and method for registration of user command

ABSTRACT

A display apparatus includes an input unit configured to receive a user command; an output unit configured to output a registration suitability determination result for the user command; and a processor configured to generate phonetic symbols for the user command, analyze the generated phonetic symbols to determine registration suitability for the user command, and control the output unit to output the registration suitability determination result for the user command. Therefore, the display apparatus may register a user command which is resistant to misrecognition and guarantees high recognition rate among user commands defined by a user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/785,722, filed on Oct. 17, 2017, which is a continuation of U.S.patent application Ser. No. 14/921,237, filed on Oct. 23, 2015, whichclaims priority from Korean Patent Application No. 10-2014-0162654,filed on Nov. 20, 2014, in the Korean Intellectual Property Office, thedisclosure of which is incorporated herein by reference in its entirety.

BACKGROUND 1. Field

The following description relates to a display apparatus and a methodfor registration of a user command, and more particularly, to a displayapparatus and method for registration of a user command defined by auser.

2. Description of the Related Art

In accordance with the technology development, as a display apparatussuch as a smartphone, a smart TV, or the like is able to recognize avoice of a user, the user may control an operation of the displayapparatus or may be provided with various content services by a spokenvoice without performing a separate manipulation. The above-mentionedvoice recognition method is based on an embedded method of recognizingthe spoken voice associated with commands which are pre-registered withthe display apparatus.

However, there is a problem that the user does not accurately know thecommands which are pre-registered with the display apparatus and doesnot effectively use a voice recognition service through the displayapparatus. Therefore, in order for the user to use the display apparatusin a more fun and flexible manner while solving the above-mentionedproblem, a technology for a method for registration of a user command inwhich the user command defined by the user is registered with thedisplay apparatus has been developed.

However, a method for registration of a user command according to therelated art focuses on a method for registration of a user command whichis simply defined by the user. That is, the method for registration ofthe user command according to the related art does not consider aproblem for misrecognition probability for the user command defined bythe user, but simply focuses on the registration of the correspondinguser command.

In a state in which the user command is registered through the methodfor registration of the user command according to the related art, inresponse to the spoken voice for the corresponding user command beinginput, a problem that the display apparatus does not accuratelyrecognize the spoken voice of the user by surrounding environmentfactors may occur. Also, in a state in which other commands similar tothe corresponding user command are pre-registered, in response to thespoken voice for the corresponding user command being input, a problemthat the display apparatus performs a control operation which is notintended by the user, based on other commands similar to the usercommand by the input spoken voice, may occur.

SUMMARY

Additional aspects and/or advantages will be set forth in part in thedescription which follows and, in part, will be apparent from thedescription, or may be learned by practice of the disclosure.

Exemplary embodiments of the present disclosure overcome the abovedisadvantages and other disadvantages not described above. Also, thepresent disclosure is not required to overcome the disadvantagesdescribed above, and an exemplary embodiment of the present disclosuremay not overcome any of the problems described above.

The present disclosure provides a display apparatus capable ofregistering a user command, which is resistant to misrecognition andguarantees a high recognition rate, among user commands defined by auser.

According to an aspect of the present disclosure, a display apparatusincludes an input unit configured to receive a user command; an outputunit configured to output a registration suitability determinationresult for the user command; and a processor configured to generatephonetic symbols for the user command, analyze the generated phoneticsymbols to determine registration suitability for the user command, andcontrol the output unit to output the registration suitabilitydetermination result for the user command.

The processor may analyze at least one of a total number of generatedphonetic symbols and a successive configuration of vowels and consonantsin the generated phonetic symbols to determine registration suitabilityfor the user command.

The processor may further analyze at least one of a configuration formof the generated phonetic symbols, the number of phonetic symbols foreach word, and whether or not the phonetic symbols include weak phoneticsymbols to determine registration suitability for the user command, andthe weak phonetic symbols may include phonetic symbols for a specificpronunciation of which a frequency band or energy magnitude is decreasedor lost by a surrounding environment, such that a recognition ratethereof is degraded.

The output unit may display a guide user interface (UI) guiding aregistrable user command in response to it being determined that aregistration of the user command is not suitable, and output an audiofor the user command in response to it being determined that theregistration of the user command is suitable.

The display apparatus may further include a storing unit; wherein theprocessor registers and stores the user command in the storing unitaccording to similarity between a text for the user command and a textfor a spoken voice in response to the spoken voice for the user commandbeing input in a state in which the audio for the user command isoutput.

The processor may determine registration suitability for the usercommand, and register and store the user command in the storing unitaccording to a selection command of a user in a case in which aregistration for the user command does not belong to both of a suitablecase and an unsuitable case.

The processor may measure similarity between phonetic symbols for aplurality of pre-registered commands and phonetic symbols of the usercommand to determine registration suitability for the user commandaccording to the measured similarity.

The processor may determine registration suitability for the usercommand according to whether or not the user command corresponds to aprohibited command.

The input unit may receive one or more texts for a spoken voice from avoice recognition apparatus in response to the spoken voice for the usercommand being input, and the processor may determine a text selected bya user among one or more input texts as a text for the user command.

The user command may include at least one of a trigger command forentering a voice recognition mode and a control command for controllingan operation of the display apparatus.

According to an aspect of the present disclosure, a method forregistration of a user command includes receiving the user command;generating phonetic symbols for the user command based on a predefinedphonetic symbol set; determining registration suitability for the usercommand by analyzing the generated phonetic symbols; and providing aregistration suitability determination result for the user command.

In the determining of registration suitability, registration suitabilityfor the user command may be determined by analyzing at least one of atotal number of generated phonetic symbols and a successiveconfiguration of vowels and consonants in the generated phoneticsymbols.

In the determining of registration suitability, registration suitabilityfor the user command may be determined by further analyzing at least oneof a configuration form of the generated phonetic symbols, the number ofphonetic symbols for each word, and whether or not the phonetic symbolsinclude weak phonetic symbols, and the weak phonetic symbols may includephonetic symbols for a specific pronunciation of which a frequency bandor energy magnitude is decreased or lost by a surrounding environment,such that a recognition rate thereof is degraded.

In the providing of the registration suitability determination resultfor the user command, a guide user interface (UI) guiding a registrableuser command may be provided in response to it being determined that aregistration of the user command is not suitable, and an audio for theuser command may be output in response to it being determined that theregistration of the user command is suitable.

The method may further include registering the user command according tosimilarity between a text for the user command and a text for a spokenvoice in response to the spoken voice for the user command being inputin a state in which the audio for the user command is output.

In the registering of the user command, registration suitability for theuser command may be determined, and the user command may be registeredaccording to a selection command of a user in a case in which theregistration for the user command does not belong to both of a suitablecase and an unsuitable case.

In the determining of registration suitability for the user command,registration suitability for the user command may be determinedaccording to similarity between phonetic symbols for a plurality ofpre-registered commands and phonetic symbols of the user command.

In the determining of registration suitability for the user command,registration suitability for the user command may be determinedaccording to whether or not the user command corresponds to a prohibitedcommand.

In the receiving of the user command, in response to a spoken voice forthe user command being input, one or more texts for the spoken voice maybe input from a voice recognition apparatus, and a text selected by auser among one or more input texts may be determined as a text for theuser command.

The user command may include at least one of a trigger command forentering a voice recognition mode and a control command for controllingan operation of the display apparatus.

According to an aspect of the present disclosure, there is provided acomputer program stored in a recording medium coupled to a displayapparatus to execute operations of: receiving a user command; generatingphonetic symbols for the user command based on a predefined phoneticsymbol set; determining registration suitability for the user command byanalyzing the generated phonetic symbols; and providing a registrationsuitability determination result for the user command, wherein thecomputer program registers the user command.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects of the present disclosure will be moreapparent by describing certain exemplary embodiments of the presentdisclosure with reference to the accompanying drawings, in which:

FIG. 1 is a block diagram of a voice recognition system according to anexemplary embodiment of the present disclosure;

FIG. 2 is a block diagram of a display apparatus according to anexemplary embodiment of the present disclosure;

FIG. 3 is a detailed block diagram of the display apparatus according tothe exemplary embodiment of the present disclosure;

FIG. 4 is a view illustrating a module determining suitability accordingto an exemplary embodiment of the present disclosure;

FIG. 5 is a illustrative view determining registration suitability for auser command based on a result value calculated by a module determiningregistration suitability in the display apparatus according to theexemplary embodiment of the present disclosure;

FIG. 6 is a first illustrative view providing a registrationunsuitability determination result for the user command in the displayapparatus according to the exemplary embodiment of the presentdisclosure;

FIG. 7 is a second illustrative view providing a registrationunsuitability determination result for a user command in a displayapparatus according to an exemplary embodiment of the presentdisclosure;

FIG. 8 is a third illustrative view providing the registrationunsuitability determination result for the user command in the displayapparatus according to an exemplary embodiment of the presentdisclosure;

FIG. 9 is a flow chart of a method for determining registrationsuitability for a user command in a display apparatus according to anexemplary embodiment of the present disclosure; and

FIG. 10 is a flow chart of a method for registration of a user commandin a display apparatus according to an exemplary embodiment of thepresent disclosure.

DETAILED DESCRIPTION

Reference will now be made in detail to the embodiments, examples ofwhich are illustrated in the accompanying drawings, wherein likereference numerals refer to like elements throughout. The embodimentsare described below to explain the present disclosure by referring tothe figures.

The exemplary embodiments of the present disclosure may be diverselymodified. Accordingly, specific exemplary embodiments are illustrated inthe drawings and are described in detail in the detailed description.However, it is to be understood that the present disclosure is notlimited to a specific exemplary embodiment, but includes allmodifications, equivalents, and substitutions without departing from thescope and spirit of the present disclosure. Also, well-known functionsor constructions are not described in detail since they would obscurethe disclosure with unnecessary detail.

The terms “first”, “second”, etc. may be used to describe diversecomponents, but the components are not limited by the terms. The termsare only used to distinguish one component from the others.

The terms used in the present application are only used to describe theexemplary embodiments, but are not intended to limit the scope of thedisclosure. The singular expression also includes the plural meaning aslong as it does not differently mean in the context. In the presentapplication, the terms “include” and “consist of” designate the presenceof features, numbers, steps, operations, components, elements, or acombination thereof that are written in the specification, but do notexclude the presence or possibility of addition of one or more otherfeatures, numbers, steps, operations, components, elements, or acombination thereof.

In the exemplary embodiment of the present disclosure, a “module” or a“unit” performs at least one function or operation, and may beimplemented with hardware, software, or a combination of hardware andsoftware. In addition, a plurality of “modules” or a plurality of“units” may be integrated into at least one module except for a “module”or a “unit” which has to be implemented with specific hardware, and maybe implemented with at least one processor (not shown).

Hereinafter, the present disclosure will be described in detail withreference to the accompanying drawings.

FIG. 1 is a block diagram of a voice recognition system according to anexemplary embodiment of the present disclosure.

As illustrated in FIG. 1, the voice recognition system includes adisplay apparatus 100, an input apparatus 200, and a web server 300.

The display apparatus 100, which is an apparatus recognizing a spokenvoice of a user to perform an operation intended by a user, may beimplemented with various electronic apparatuses such as a smart TV, asmart phone, a tablet PC, and the like.

The input apparatus 200, which is an apparatus performing datacommunication with the display apparatus 100 to control an operation ofthe display apparatus 100, may be, for example, a remote controller, akeyboard, or the like.

Specifically, a first user may speak to operate the display apparatus100 in a voice recognition mode. In response to a spoken voice of theuser described above being input to the display apparatus 100, thedisplay apparatus 100 analyzes a voice signal for the input spoken voiceto determine whether or not the corresponding voice signal is a triggercommand for entering the display apparatus 100 into the voicerecognition mode. As the determination result, in response to thecorresponding voice signal being the command for operating the displayapparatus 100 in the voice recognition mode, the display apparatus 100enters the voice recognition mode. As such, in a state in which thedisplay apparatus 100 enters the voice recognition mode, in response toan additional spoken voice of the user being input to the displayapparatus 100, the display apparatus 100 internally converts theadditionally spoken voice into a text. However, the present disclosureis not limited thereto. For example, in the state in which the displayapparatus 100 enters the voice recognition mode, in response to thespoken voice of the user being input through the input apparatus 200 orthe voice recognition for the spoken voice of the user is impossible,the display apparatus 100 may receive a text for the spoken voice of theuser through a voice recognition apparatus 300.

Here, the voice recognition apparatus 300 may be an apparatus performingthe data communication with the display apparatus 100 to perform thevoice recognition for the spoken voice of the user from the displayapparatus 100 and transmitting a recognized voice recognition result tothe display apparatus 100.

Thereafter, the display apparatus 100 may control the operation of thedisplay apparatus 100 based on the text for the spoken voice of the useror receive and display response information corresponding to the spokenvoice of the user from the web server (not illustrated).

Here, the web server (not illustrated) is a server providing contentrelated information. For example, if the speaking “please retrieve ∘∘∘”is input from the user, a communication unit 160 may receive retrievedresults associated with “∘∘∘” from the web server (not illustrated).

Meanwhile, an execution command controlling the operation of the displayapparatus 100 with regard to the spoken voice of the user may beregistered and set by the user. Hereinafter, an execution commandintended to be registered and set by the user is referred to as a usercommand. Specifically, the user may input the user command intended tobe registered and set by himself or herself through the input apparatus200. If the user command described above is input to the displayapparatus 100, the input apparatus 200 transmits user commandregistration request information including a user command of a text typeto the display apparatus 100. However, the present disclosure is notlimited thereto. For example, in a state in which the display apparatus100 is set in a user command registration mode, the display apparatus100 may receive the spoken voice for the user command through amicrophone. In response to the spoken voice for the user command asdescribed above being input to the display apparatus 100, the displayapparatus 100 may transmit the input spoken voice to the voicerecognition apparatus 300 and may receive a user command converted intothe text type from the voice recognition apparatus 300.

In response to the user command of the text type as described abovebeing received from the input apparatus 200 or the voice recognitionapparatus 300, the display apparatus 100 generates phonetic symbols forthe user command of the text type. Thereafter, the display apparatus 100analyzes the phonetic symbols for the user command by a predeterminedsuitability determination condition to determine registrationsuitability of the user command requested by the user. Here, thesuitability determination condition may be at least one of a totalnumber of phonetic symbols, whether or not vowels and consonants of thephonetic symbols are successive, a configuration form of the phoneticsymbols, the number of phonetic symbols for each word, and whether ornot predefined weak phonetic symbols are included.

Therefore, the display apparatus 100 analyzes the phonetic symbols forthe user command by the suitability determination condition as describedabove to determine registration suitability of the user command andoutputs the determination result to at least one of a user interface(UI) and an audio device. In a case in which it is determined that theregistration of the user command is unsuitable, the user may re-input aregistrable user command, and the display apparatus 100 may re-performthe above-mentioned operations to re-perform a registration suitabilitydetermination for the re-input user command. Meanwhile, in a case inwhich it is determined that the registration of the user command issuitable, the display apparatus 100 registers the user command accordingto a registration request for the corresponding user command. Therefore,the user may control the operation of the display apparatus 100 usingthe user command set by himself or herself.

Hereinabove, the respective configurations of the voice recognitionsystem according to the present disclosure have been schematicallydescribed. Hereinafter, the respective configurations of the displayapparatus 100 described above will be described in detail.

FIG. 2 is a block diagram of the display apparatus according to anexemplary embodiment of the present disclosure and FIG. 3 is a detailedblock diagram of the display apparatus according to the exemplaryembodiment of the present disclosure.

As illustrated in FIG. 2, the display apparatus 100 includes an inputunit 110, an output unit 120, and a processor 140. Additionally, thedisplay apparatus 100 may further include a voice processing unit 150, acommunication unit 160, and a storing unit 170 as illustrated in FIG. 3,in addition to the configuration of the input unit 110, the output unit120, and the processor 140.

The input unit 110, which is an input for receiving various usermanipulations and transferring various user manipulations to theprocessor 140, may be implemented as an input panel. Here, the inputpanel may be formed in a touch pad, or a key pad or touch screen typeincluding a variety of function keys, number keys, special keys, letterkeys, and the like. As well, the input unit 170 may receive a controlcommand transmitted from a remote control apparatus 200 such as a remotecontroller or a keyboard for controlling the operation of the displayapparatus 100. As well, the input unit 110 may receive the spoken voiceof the user through a microphone (not illustrated). The input unit 110as described above may receive a user command of a text type from theremote control apparatus 200 or may receive the spoken voice for theuser command through the microphone (not illustrated). Here, the usercommand, which is an execution command defined by the user to controlthe operation of the display apparatus 100, may be at least one of atrigger command for entering the display apparatus 100 into the voicerecognition mode and a control command for controlling the operation ofthe display apparatus 100.

The output unit 120 outputs the registration suitability determinationresult for the user command input through the input unit 110. The outputunit 120 as described above may include a display unit 121 and an audiooutput unit 123 as illustrated in FIG. 3. Therefore, the output unit 120may output the registration suitability determination result for theuser command through at least one of the display unit 121 and the audiooutput unit 123.

Meanwhile, the processor 140, which is a configuration generally takingcharge of the control of the apparatus, may be used interchangeably witha central processing unit, a microprocessor, a controlling unit, and thelike. In addition, the processor 140, which is to control a generaloperation of the apparatus, may be implemented as system-on-a-chip (SOC)or system on chip (SoC) with other function units.

Such processor 140 generally controls operations of all ofconfigurations constituting the display apparatus 100. Particularly, theprocessor 140 may copy a phonetic symbol generation related programpre-stored in the storing unit 170 in a random access memory (RAM)according to the user command for a user command registration and maygenerate phonetic symbols for the user command of the text type usingthe phonetic symbol generation related program copied in the RAM.

More specifically, the processor 140 may generate the phonetic symbolsfor the user command of the text type based on a predefined phoneticsymbol set. Here, the predefined phonetic symbol set may include atleast one of vowels, diphthongs, consonants, affricates, accents, andsymbols. If such phonetic symbols for the user command are generated,the processor 140 analyzes a pre-generated phonetic symbol based on apredetermined suitability determination condition to determineregistration suitability for the user command. Thereafter, the processor140 controls the output unit 120 to output the registration suitabilitydetermination result for the user command.

Specifically, if the registration request information for the usercommand defined by the user is input through the input unit 110, theprocessor 140 enters a registration performing mode for the usercommand. Here, the registration request information may be requestinformation for registering the user command associated with the triggercommand for entering the voice recognition mode or request informationfor registering the user command associated with the control command forcontrolling the operation of the display apparatus 100. In response tothe user command corresponding to the registration request of the userbeing input through the input unit 110 after such registration requestinformation is input, the processor 140 generates the input user commandin a phonetic symbol form. According to an exemplary embodiment, inresponse to the spoken voice associated with the user command outputfrom a microphone (not illustrated) being input through the input unit110, the processor 140 performs a control so that the voice processingunit 150 performs a voice recognition for the spoken voice of the user.According to such control command, the voice processing unit 150 mayconvert the spoken voice of the user into the text using a speech totext (STT) algorithm.

According to an exemplary embodiment, in response to the spoken voiceassociated with the user command output from a microphone (notillustrated) being input through the input unit 110, the processor 140transmits the spoken voice associated with the user command to the voicerecognition apparatus 300. Thus, the voice recognition apparatus 300performs the voice recognition for the received spoken voice andtransmits the voice recognition result of the text type to the displayapparatus 100. In this case, the voice recognition apparatus 300 maytransmit at least one voice recognition result of the text type withregard to the spoken voice of the user to the display apparatus 100.Therefore, in a case in which a plurality of texts for the spoken voiceof the user are received from the voice recognition apparatus 300, theprocessor 140 controls the output unit 120 to display a list for theplurality of texts. Thus, the output unit 120 displays the list for theplurality of texts through the display unit 121. In a state in whichsuch list is displayed, in response to a selection command for one textbeing input, the processor 140 may determine a text corresponding to theinput selection command as a text for the spoken voice of the user.

According to an exemplary embodiment, the processor 140 may determinethe subject to perform the voice recognition for the spoken voice of theuser depending on whether data communication with the voice recognitionapparatus 300 may be performed through the communication unit 160. Thatis, if the data communication with the voice recognition apparatus 300may be performed, the processor 140 may receive the voice recognitionresult for the spoken voice of the user from the voice recognitionapparatus 300, and if the data communication with the voice recognitionapparatus 300 may not be performed, the processor 140 may perform thevoice recognition for the spoken voice of the user by the voiceprocessing unit 150.

Here, the communication unit 160 performs the data communication withthe voice recognition apparatus 300 and receives the voice recognitionresult for the spoken voice of the user from the voice recognitionapparatus 300. As well, the communication unit 160 may perform the datacommunication with the input apparatus 200 and may receive at least oneof the user command for controlling the operation of the displayapparatus 100 and the spoken voice of the user. Additionally, thecommunication unit 160 may perform the data communication with a webserver (not illustrated) and may receive the response informationcorresponding to the spoken voice of the user.

Such communication unit 160 may include various communication modulessuch as a local area wireless communication module (not illustrated), awireless communication module (not illustrated), and the like. Here, thelocal area wireless communication module (not illustrated), which is acommunication module performing wireless communication with at least oneof the input apparatus 200 and the web server (not illustrated) locatedat a local area, may be, for example, Bluetooth, Zigbee, or the like.The wireless communication module (not illustrated) is a moduleconnected to an external network according to a wireless communicationprotocol such as WiFi, IEEE, or the like, to perform communication. Thewireless communication module may further include a mobile communicationmodule connected to a mobile communication network according to variousmobile communication standards such as 3rd generation (3G), 3rdgeneration partnership project (3GPP), Long Term Evolution (LTE), andthe like to perform communication.

Meanwhile, if the spoken voice associated with the user command isconverted into the text type or is received from the voice recognitionapparatus 300 according to various exemplary embodiments describedabove, the processor 140 generates the phonetic symbols for the usercommand of the text type based on the predefined phonetic symbol set.For example, in response to a user command of a text type called“kangazi” being input, the processor 140 may generate phonetic symbols[k:ang_a:_zi] from the user command of the text type called “kangazi”.

If such phonetic symbols are generated, the processor 140 analyzes thegenerated phonetic symbols based on the predetermined suitabilitydetermination condition to determine registration suitability for theuser command. As the determination result, if it is determined that theregistration of the user command is suitable, the processor 140registers and stores the user command defined by the user in the storingunit 170. Thereafter, in response to the speaking for the user commandregistered and stored in the storing unit 170 being input, the processor140 may control the operation of the display apparatus 100 based on theuser command associated with the input speaking. FIG. 4 is a viewillustrating a module determining suitability according to an exemplaryembodiment of the present disclosure.

As illustrated in FIG. 4, the module 410 determining registrationsuitability may include at least one of a module 411 analyzing a totalnumber of phonetic symbols, a module 413 analyzing a configuration ofvowels and consonants configuring the phonetic symbols, a module 415analyzing a configuration form of the phonetic symbols, a module 417analyzing the phonetic symbols for each word configuring the usercommand, and a module 419 detecting weak phonetic symbols.

Here, the module analyzing the total number of phonetic symbols(hereinafter, referred to as a first condition) is a module determiningwhether or not the total number of phonetic symbols for the user commandincludes a predetermined number or more. In addition, the moduleanalyzing the configuration of the vowels and consonants configuring thephonetic symbols (hereinafter, referred to as a second condition) is amodule determining whether or not the vowels or the consonants aresuccessively overlapped on the phonetic symbols for the user command. Inaddition, the module analyzing the configuration form of the phoneticsymbols (hereinafter, referred to as a third condition) is a moduledetecting whether the configuration of the phonetic symbols for the usercommand is listed in which form based on the predefined phonetic symbolset. In addition, the module analyzing the phonetic symbols for eachword (hereinafter, referred to as a fourth condition) is a moduledetermining whether or not the number of respective words configuringthe user command and the number of phonetic symbols corresponding toeach word are the predetermined number or more, or are less than thepredetermined number. In addition, the module detecting the weakphonetic symbols (hereinafter, referred to as a fifth condition) is amodule determining whether or not phonetic symbols of a beginning and anend among the phonetic symbols configuring the user command arepredefined weak phonetic symbols. Here, the predefined weak phoneticsymbols may be phonetic symbols for a specific pronunciation of which afrequency band or energy magnitude is decreased or lost by a surroundingenvironment such as living noise, or the like, such that a recognitionrate thereof is degraded.

Therefore, the processor 140 may analyze the phonetic symbols for theuser command using at least one of the first to fifth conditionsincluded in the module determining registration suitability to determineregistration suitability for the user command.

According to an exemplary embodiment, the processor 140 may analyze thephonetic symbols generated from the user command using the modulescorresponding to the first and second conditions among the modulesincluded in the module determining registration suitability to determineregistration suitability for the user command.

For example, if the user command of the text type called “kangazi” isinput, the processor 140 may generate phonetic symbols [k:ang_a:_zi]from the user command of the text type called “kangazi”. If suchphonetic symbols are generated, the processor 140 determines whether ornot the total number of phonetic symbols [k:ang_a:_zi] is thepredetermined number or more using a module corresponding to the firstcondition among the modules included in the module determiningregistration suitability. For example, if the predetermined numbermatching the first condition is five and the total number of phoneticsymbols [k:ang_a:_zi] is seven, the processor 140 determines that thetotal number of phonetic symbols is the predetermined number or more anddetermines that the user command is matched to the first condition.

If the user command is matched to such first condition, the processor140 determines whether or not at least one of the vowels and theconsonants on the phonetic symbols [k:ang_a:_zi] is configured in asuccessive form using a module corresponding to the second conditionamong the modules included in the module determining registrationsuitability. As the determination result, if at least one of the vowelsand consonants is not configured in the successive form, the processor140 determines that the user command is matched to the second condition.As such, if the user command is matched to the first and secondconditions, the processor 140 may determine that the registration forthe user command “kangazi” is suitable.

As another example, if a user command of a text type called “a a a a a”is input, the processor 140 may generate phonetic symbols [a_a_a_a_a]from the user command of the text type called “a a a a a”. In this case,the processor 140 determines that vowels of the phonetic symbols[a_a_a_a_a] are successive. As such, if the user command is not matchedto at least one of the first and second conditions, the processor 140may determine that the registration for the user command “a a a a a” isnot suitable. That is, the user command having successive vowels has aproblem that the spoken voice of the user spoken with regard to theregistered user command may be recognized to be different from thecorresponding user command. Therefore, as in the example describedabove, the processor 140 may determine that the user command having thesuccessive vowels is not suitable as the user command. According to anexemplary embodiment, the processor 140 may determine the registrationsuitability for the user command using the modules corresponding to thefirst and second conditions and the modules corresponding to at leastone of the third to fifth conditions among the modules included in themodule determining registration suitability.

For example, if phonetic symbols [skaip_TV] are generated from a usercommand of a text type “skype TV”, the processor 140 analyzes thephonetic symbols [skaip_TV] using the modules corresponding to the firstand second conditions among the modules included in the moduledetermining registration suitability to determine registrationsuitability for the corresponding user command. As the determinationresult, if the total number of phonetic symbols [skaip_TV] is thepredetermined number or more and at least one of the vowels andconsonants is not successive, the processor 140 determines that the usercommand “skype TV” is matched to the first and second conditions. Assuch, if the user command is matched to the first and second conditions,the processor 140 analyzes the phonetic symbols [skaip_TV] using themodule corresponding to at least one of the third to fifth conditionsamong the modules included in the module determining registrationsuitability to determine registration suitability for the correspondinguser command.

Specifically, the processor 140 analyzes a configuration form of thephonetic symbols [skaip_TV] by the module corresponding to the thirdcondition to determine whether or not components configuring thecorresponding phonetic symbols are distributed in the ordercorresponding to a predefined pattern.

For example, a first pattern which is predefined may be defined in theorder of a consonant, a consonant, a vowel, a vowel, a consonant, aconsonant, and the like, a second pattern may be defined in the order ofa vowel, a consonant, a symbol, an affricate, a vowel, a consonant, andthe like, and a third pattern may be defined in the order of aconsonant, a vowel, a consonant, a vowel, a consonant, a vowel, aconsonant, the like.

In this case, the processor 140 may determine that the componentsconfiguring the phonetic symbols [skaip_TV] are listed based on thefirst pattern among the first to third patterns.

Meanwhile, as in the example described above, the phonetic symbols[k:ang_a:_zi] may be generated from the user command of the text type“kangazi” In this case, the processor 140 may determine that thecomponents configuring the phonetic symbols [k:ang_a:_zi] are listedbased on the third pattern among the first to third patterns. As such,if it is determined that the components configuring the phonetic symbolsgenerated from the user command of the text type are listed based on thepredefined pattern, the processor 140 determines that the user commandis matched to the third condition.

If the user command is matched to the third condition, the processor 140determines whether or not the number of words configuring the usercommand and the number of phonetic symbols for each word are thepredetermined number or more, or are less than the predetermined numberby the module corresponding to the fourth condition.

As in the example described above, the phonetic symbols [skaip_TV]generated with regard to the user command “skype TV” may be matched tothe third condition. In this case, the processor 140 determines whetheror not the number of words configuring the user command and the numberof phonetic symbols for each word among the phonetic symbols [skaip_TV]are the predetermined number or more, or are less than the predeterminednumber by the module corresponding to the fourth condition.

For example, the user command which is suitable for registration may becombined of two or more words, and the phonetic symbols for each wordmay be predetermined to be two or more. Meanwhile, the user command“skype TV” may be configured of two words “skype” and “TV”, and thephonetic symbols for each of “skype” and “TV” may be [skaip] and [TV].In this case, the user command “skype TV” may be configured of the twowords and the number of phonetic symbols of each word may be two ormore. As such, if the number of words configuring the user command“skype TV” and the number of phonetic symbols for each word are thepredetermined number or more or are less than the predetermined number,the processor 140 may determine that the user command “skype TV” ismatched to the fourth condition.

If the user command is matched to the fourth condition, the processor140 determines whether or not phonetic symbols of a beginning and an endof the phonetic symbols for each word configuring the user commandinclude the predefined weak phonetic symbols by the module correspondingto the fifth condition. Here, the predefined weak phonetic symbol may bea phonetic symbol for a specific pronunciation of which a frequency bandor energy magnitude is decreased or lost by a surrounding environmentsuch as living noise, or the like, such that a recognition rate thereofis degraded. In general, in a case in which a pronunciation begins orends with phonetic symbols such as [s], [p], [f], and [k], thepronunciation associated with the corresponding phonetic symbols has afrequency band or energy magnitude which is decreased or lost by asurrounding environment, such that a recognition rate thereof may bedegraded.

Therefore, the processor 140 analyzes the phonetic symbols for each wordfor each of “skype” and “TV” configuring the user command “skype TV” todetermine whether or not the beginning or the end of the phoneticsymbols includes the predefined weak phonetic symbol. As describedabove, the phonetic symbols of a word “skype” may be “[skaip]”, and thebeginning and the end of the above-mentioned phonetic symbols mayinclude [s] and [p]. Therefore, the processor 140 may determine that theuser command “skype TV” is not matched to the fifth condition.

As such, if the user command which is determined that the registrationthereof is suitable by the modules corresponding to the first and secondconditions is determined that the registration thereof is not suitableby the module corresponding to at least one of the third to fifthconditions, the processor 140 may finally determine that theregistration of the corresponding user command is not suitable.

According to an exemplary embodiment, the processor 140 may determineregistration suitability for the user command for the respective modulescorresponding to the first to fifth conditions included in the moduledetermining registration suitability and may finally determineregistration suitability for the user command based on a result valueaccording to the determination result.

As described above, the processor 140 determines registrationsuitability for the user command for the respective modulescorresponding to the first to fifth conditions included in the moduledetermining registration suitability. Thereafter, the processor 140 maycalculate a result value for the user command based on the registrationsuitability determination result for each module and may finallydetermine registration suitability for the user command based on thecalculated result value.

According to the exemplary embodiment, the processor 140 determinesregistration suitability for the user command for the respective modulescorresponding to the first to fifth conditions included in the moduledetermining registration suitability. If it is determined that theregistration with regard to at least one condition of the first to fifthconditions is not suitable, the processor 140 may sum predeterminedreference values for the respective modules corresponding to otherconditions except for the condition in which the registration is notsuitable, among the first to fifth conditions to calculate the resultvalue for the user command.

Here, the reference values set for the respective modules correspondingto the first to fifth conditions may be set to be equal to each other orto be different from each other. In a case in which different referencevalues are set for the respective modules corresponding to the first tofifth conditions, a reference value of a module corresponding to thehighest priority in a registration suitability determination referenceamong the modules corresponding to the first to fifth conditions may beset to be highest and a reference value of a module corresponding to thelowest priority may be set to be lowest. If the result valuecorresponding to an analysis result of the user command is calculatedthrough the exemplary embodiment described above, the processor 140 mayfinally determine registration suitability for the user command based onthe calculated result value.

FIG. 5 is an illustrative view determining registration suitability forthe user command based on the result value calculated by the moduledetermining registration suitability in the display apparatus accordingto the exemplary embodiment of the present disclosure.

The processor 140 may determine registration suitability for the usercommand for the respective modules corresponding to the first to fifthconditions included in the module determining registration suitabilityand may calculate the result value for the user command based on theregistration suitability determination result for each module.

If the result value for the user command is calculated, the processor140 may determine registration suitability for the user commanddepending on sections to which the calculated result value belongs, withreference to a registration determination reference model 500illustrated in FIG. 5.

Specifically, if the result value corresponding to the analysis resultof the user command belongs to a first threshold section 510, theprocessor 140 determines that the registration for the user command isnot suitable. Meanwhile, if the result value corresponding to theanalysis result of the user command belongs to a second thresholdsection 530, the processor 140 determines that the registration for theuser command is suitable. Meanwhile, if the result value correspondingto the analysis result of the user command belongs to a third thresholdsection 520 between the first and second threshold sections, theprocessor 140 may determine that the registration for the user commandis suitable according to a selection command of the user for the usercommand.

Meanwhile, if the result value corresponding to the analysis result ofthe user command belongs to the second threshold section 530, theprocessor 140 may determine whether or not the registration for the usercommand is suitable as the control command or is suitable as the triggercommand according to the registration request information of the user.

Specifically, in a state in which the registration request informationfor controlling the operation of the display apparatus 100 is input, theresult value corresponding to the analysis result of the user commandmay belong to a 2-1-th threshold section 531 of the second thresholdsection 530. In this case, the processor 140 may determine that theregistration for the user command is suitable as the control command forcontrolling the operation of the display apparatus 100.

Meanwhile, in a state in which the registration request information foroperating the display apparatus 100 in the voice recognition mode isinput, the result value corresponding to the analysis result of the usercommand may belong to a 2-2-th threshold section 533 of the secondthreshold section 530. In this case, the processor 140 may determinethat the registration for the user command is suitable as the triggercommand for operating the display apparatus 100 in the voice recognitionmode.

Meanwhile, in the state in which the registration request informationfor operating the display apparatus 100 in the voice recognition mode isinput, if the result value corresponding to the analysis result of theuser command belongs to a 2-1-th threshold section 531 of the secondthreshold section 530, the processor 140 may determine that theregistration for the user command is suitable as the trigger command foroperating the display apparatus 100 in the voice recognition modeaccording to the selection command of the user for the user command.

Meanwhile, according to an aspect of the present disclosure, after theprocessor 140 determines similarity between the spoken voice of the userand a plurality of commands which are pre-registered or whether or notthe spoken voice of the user corresponds to a prohibited command, theprocessor 140 may determine registration suitability for the usercommand according to various exemplary embodiments described above.

According to an exemplary embodiment, the processor 140 measuressimilarity between the phonetic symbols generated from the user commandand pre-stored phonetic symbols for a plurality of commands using asimilarity algorithm such as a confusion matrix to calculate reliabilityvalues accordingly. Thereafter, the processor 140 compares therespective calculated reliability values with a predetermined thresholdvalue to determine whether or not the respective reliability values areless than the predetermined threshold value. As the determinationresult, if at least one reliability value is the predetermined thresholdvalue or more, the processor 140 determines that the user command and atleast one pre-registered command are similar to each other anddetermines that the registration for the user command is not suitable.Meanwhile, if all of the reliability values are less than thepredetermined threshold value, the processor 140 determines that theregistration for the user command is suitable.

According to an exemplary embodiment, the processor 140 determineswhether or not the user command is an unregistrable command withreference to the prohibited commands which are registered and stored inthe storing unit 170. As the determination result, if the user commandis associated with at least one prohibited command, the processor 140determines that the registration for the user command is not suitable.Meanwhile, if the user command is not associated with at least oneprohibited command, the processor 140 determines that the registrationfor the user command is suitable.

In this case, the processor 140 may perform at least one of a firstdetermination operation of determining whether or not the user commandis similar to the pre-registered command and a second determinationoperation of determining whether or not the corresponding user commandis the prohibited command, as described above.

If the registration suitability for the user command is primarilydetermined by at least one of the first determination operation and thesecond determination operation described above, the processor 140determines registration suitability for the user command according tovarious exemplary embodiments described above. If it is determined thatthe registration of the user command is suitable, the processor 140 mayprovide the registration suitability determination result of the usercommand through the output unit 120. Specifically, if it is determinedthat the registration for the user command is suitable, the audio outputunit 123 outputs an audio for the user command according to a controlcommand of the processor 140. In a state in which the above-mentionedaudio is output, if the spoken voice of the user is input within thepredetermined threshold time, the processor 140 registers and stores theuser command in the storing unit 170 according to a degree of similaritybetween the text for the user command and the text for the spoken voiceof the user. Specifically, if the spoken voice is input after the audiofor the user command is output, the processor 140 may convert the inputspoken voice into the text type or receive the voice recognition resultconverted into the text type from the voice recognition apparatus 300.Thereafter, the processor 140 measures similarity between the phoneticsymbols for the user command and the phonetic symbols for the spokenvoice using the similarity algorithm such as the confusion matrix, andresisters and stores the user command in the storing unit 170 if thesimilarity value according to the measurement is the predeterminedthreshold value or more.

Meanwhile, if it is determined that the registration for the usercommand is not suitable, the display unit 121 displays an analysisresult analyzed according to the predetermined suitability determinationconditions and a guide UI guiding a registrable user command, accordingto the control command of the processor 140. Accordingly, the user mayre-input a user command matched to the registration determinationcondition with reference to the guide UI displayed on a screen of thedisplay apparatus 100.

Hereinafter, in a case in which the registration for the user command isnot suitable in the display apparatus 100, an operation of providing adetermination result according to the above-mentioned unsuitableregistration will be described in detail with reference to FIGS. 6 to 8.

FIG. 6 is a first illustrative view providing a registrationunsuitability determination result for the user command in the displayapparatus according to the exemplary embodiment of the presentdisclosure.

As illustrated in FIG. 6, a first user command 610 defined by the usermay be determined that a registration thereof is not suitable, by themodule corresponding to the fourth condition among the modules includedin the module determining registration suitability described above. Asdescribed above, the module corresponding to the fourth condition is themodule determining whether or not the number of respective wordsconfiguring the user command and the number of phonetic symbolscorresponding to each word are the predetermined number or more, or areless than the predetermined number.

Therefore, if the number of respective words configuring the first usercommand 610 exceeds the predetermined number, the processor 140 maydetermine that the registration for the first user command 610 is notsuitable. As such, if it is determined that the registration for thefirst user command 610 is not suitable, the display apparatus 100 maydisplay a guide UI 620 “this is an overlong command” on the screenthereof through the display unit 121.

Therefore, the user may re-input a user command consisting of wordssmaller than the first user command 610 with reference to the guide UI620 displayed on the screen.

FIG. 7 is a second illustrative view providing the registrationunsuitability determination result for the user command in the displayapparatus according to an exemplary embodiment of the presentdisclosure.

As illustrated in FIG. 7, a second user command 710 defined by the usermay be determined that a registration thereof is not suitable, by themodule corresponding to the fourth condition among the modules includedin the module determining registration suitability described above. Asdescribed above, the module corresponding to the fourth condition is themodule determining whether or not the number of respective wordsconfiguring the user command and the number of phonetic symbolscorresponding to each word are the predetermined number or more, or areless than the predetermined number.

Therefore, if the number of respective words configuring the second usercommand 710 is less than the predetermined number, the processor 140 maydetermine that the registration for the second user command 710 is notsuitable. As such, if it is determined that the registration for thesecond user command 710 is not suitable, the display apparatus 100 maydisplay a guide UI 720 including determination result information “aninput command is not suitable for registration” and recommendinformation for the user command such as “Recommend: Run Skype, SkypeTV” on the screen thereof through the display unit 121.

Therefore, the user may re-input a user command that he or she desireswith reference to the user command recommended with regard to the seconduser command 710 through the guide UI 720 displayed on the screen.

FIG. 8 is a third illustrative view providing the registrationunsuitability determination result for the user command in the displayapparatus according to an exemplary embodiment of the presentdisclosure.

As illustrated in FIG. 8, a third user command 810 defined by the usermay be determined that a registration thereof is not suitable, by themodule corresponding to the fifth condition among the modules includedin the module determining registration suitability described above. Asdescribed above, the module corresponding to the fifth condition is themodule determining whether or not the phonetic symbols of the beginningand the end among the phonetic symbols configuring the user command arethe predefined weak phonetic symbols.

Therefore, if the phonetic symbol of at least one of the beginning andthe end on the phonetic symbols for the respective words configuring athird user command 810 is the weak phonetic symbol, the processor 140may determine that the registration for the third user command 810 isnot suitable. As such, if it is determined that the registration for thethird user command 810 is not suitable, the display apparatus 100 maydisplay a guide UI 820 including determination result information “thisincludes an unsuitable pronunciation” and weak pronunciation informationguiding the unsuitable pronunciation such as “Skype [S,Pe]” on thescreen thereof through the display unit 121.

Therefore, the user may re-input a user command excluding the unsuitableweak pronunciation with reference to the guide UI 820 displayed on thescreen.

Hereinabove, the operations of registering the user commands defined bythe user in the display apparatus 100 according to the presentdisclosure have been described in detail. Hereinafter, a method forregistration of a user command defined by the user in the displayapparatus 100 according to the present disclosure will be described indetail.

FIG. 9 is a flow chart of a method for determining registrationsuitability for the user command in the display apparatus according toan exemplary embodiment of the present disclosure.

As illustrated in FIG. 9, if the user command defined by the user isinput, the display apparatus 100 determines whether the input usercommand is a command of a text type or a spoken voice (operation S910and operation S920).

Specifically, if the registration request information for the usercommand defined by the user is input, the display apparatus 100 enters aregistration performing mode for the user command. Here, theregistration request information may be request information forregistering the user command associated with the trigger command forentering the voice recognition mode or request information forregistering the user command associated with the control command forcontrolling the operation of the display apparatus 100.

In a state in which such registration request information is input, thedisplay apparatus 100 determines whether or not a user commandcorresponding to the registration request of the user is input from theinput apparatus 200. As the determination result, if the spoken voicefor the user command is input through the input apparatus 200 such as amicrophone (not illustrated) or a remote controller, the displayapparatus 100 receives the voice recognition result for the spoken voiceconverted into the text from the voice recognition apparatus 300(operation S930). However, the present disclosure is not limitedthereto. If the data communication with the voice recognition apparatus300 is not performed or the spoken voice for the user command is inputthrough the microphone, the display apparatus 100 may convert the spokenvoice of the user into the text using the speech to text (STT)algorithm. Meanwhile, the voice recognition apparatus 300 transmittingthe voice recognition result for the spoken voice associated with theuser command to the display apparatus 100 may transmit at least onevoice recognition result of the text type with regard to the spokenvoice of the user to the display apparatus 100. Therefore, in a case inwhich a plurality of texts for the spoken voice of the user are receivedfrom the voice recognition apparatus 300, the display apparatus 100displays a list for the plurality of texts. Thereafter, if a selectioncommand for one text is input, the display apparatus 100 may determine atext corresponding to the input selection command as a text for thespoken voice of the user.

If the user command of the text type is input according to variousexemplary embodiments described above, the display apparatus 100generates phonetic symbols for the user command of the text type basedon the predefined phonetic symbol set (operation S940). Thereafter, thedisplay apparatus 100 analyzes the generated phonetic symbols based onthe predetermined suitability determination condition to determineregistration suitability for the user command (operation S950).Thereafter, the display apparatus 100 provides the registrationsuitability determination result for the user command (operation S960).

Specifically, the display apparatus 100 analyzes the pre-generatedphonetic symbols with regard to the user command according to thepredetermined registration suitability determination module with regardto the suitability determination condition to determine registrationsuitability for the user command. Here, the module determiningregistration suitability may include at least one of the moduleanalyzing a total number of phonetic symbols (first condition), themodule analyzing a configuration of vowels and consonants configuringthe phonetic symbols (second condition), the module analyzing aconfiguration form of the phonetic symbols (third condition), the moduleanalyzing the phonetic symbols for each word configuring the usercommand (fourth condition), and the module detecting weak phoneticsymbols (fifth condition), as described in FIG. 4. Since the respectivemodules have been described in detail with reference to FIG. 4, a detaildescription thereof will be omitted.

According to an exemplary embodiment, the display apparatus 100 mayanalyze the phonetic symbols generated from the user command using themodules corresponding to the first and second conditions among themodules included in the module determining registration suitability todetermine registration suitability for the user command.

According to an exemplary embodiment, the display apparatus 100 maydetermine registration suitability for the user command using themodules corresponding to the first and second conditions and the modulecorresponding to at least one of the third to fifth conditions among themodules included in the module determining registration suitability.

According to an exemplary embodiment, the display apparatus 100 maydetermine registration suitability for the user command for therespective modules corresponding to the first to fifth conditionsincluded in the module determining registration suitability and mayfinally determine registration suitability for the user command based ona result value according to the determination result.

Specifically, the display apparatus 100 determines registrationsuitability for the user command for the respective modulescorresponding to the first to fifth conditions included in the moduledetermining registration suitability. If it is determined that theregistration with regard to at least one condition of the first to fifthconditions is not suitable, the display apparatus 100 may sumpredetermined reference values for respective modules corresponding toother conditions except for the condition in which the registration isnot suitable, among the first to fifth conditions to calculate theresult value for the user command.

Here, the reference values set for the respective modules correspondingto the first to fifth conditions may be set to be equal to each other orto be different from each other. In a case in which different referencevalues are set for the respective modules corresponding to the first tofifth conditions, a reference value of a module corresponding to thehighest priority in a registration suitability determination referenceamong the modules corresponding to the first to fifth conditions may beset to be highest and a reference value of a module corresponding to thelowest priority may be set to be lowest.

Therefore, if the result value for the user command is calculated by themodule determining suitability described above, the display apparatus100 may determine registration suitability for the user commanddepending on sections to which the calculated result value belongs, withreference to a registration determination reference model. Specifically,as described in FIG. 5, if the result value corresponding to theanalysis result of the user command belongs to the first thresholdsection 510, the display apparatus 100 determines that the registrationfor the user command is not suitable. Meanwhile, if the result valuecorresponding to the analysis result of the user command belongs to thesecond threshold section 530, the display apparatus 100 determines thatthe registration for the user command is suitable. Meanwhile, if theresult value corresponding to the analysis result of the user commandbelongs to the third threshold section 520 between the first and secondthreshold sections, the display apparatus 100 may determine that theregistration for the user command is suitable according to the selectioncommand of the user for the user command.

Meanwhile, the display apparatus 100 may determine whether theregistration for the user command belonging to the second thresholdsection is suitable as the control command or is suitable as the triggercommand according to the registration request information of the user.

Meanwhile, according to an aspect of the present disclosure, after thedisplay apparatus 100 determines similarity between the spoken voice ofthe user and a plurality of commands which are pre-registered or whetheror not the spoken voice of the user corresponds to a prohibited command,the display apparatus 100 may determine registration suitability for theuser command according to various exemplary embodiments described above.According to an exemplary embodiment, the display apparatus 100determines registration suitability for the user command according to adegree of similarity between a plurality of pre-registered commands andthe user command (first determination operation). As the determinationresult, if it is determined that the user command is similar to at leastone of the plurality of commands, the display apparatus 100 determinesthat the registration for the user command is not suitable. Meanwhile,if it is determined that the user command is not similar to theplurality of commands, the display apparatus 100 may perform anoperation of determining registration suitability for the user commandaccording to various exemplary embodiments described above.

The display apparatus 100 according to an exemplary embodimentdetermines whether the user command is the unregistrable command withreference to the pre-registered prohibited commands (seconddetermination operation). As the determination result, if the usercommand is associated with at least one prohibited command, the displayapparatus 100 determines that the registration for the user command isnot suitable. Meanwhile, if the user command is not associated with atleast one prohibited command, the display apparatus 100 may perform theoperation of determining registration suitability for the user commandaccording to various exemplary embodiments described above.

In this case, the display apparatus 100 may perform at least one of thefirst determination operation of determining whether or not the usercommand is similar to the pre-registered command and the seconddetermination operation of determining whether or not the correspondinguser command is the prohibited command.

If registration suitability for the user command is primarily determinedby at least one of the first determination operation and the seconddetermination operation, the display apparatus 100 provides theregistration suitability determination result for the user command.Specifically, if it is determined that the registration for the usercommand is not suitable, the display unit 100 displays the analysisresult information analyzed according to the module determiningregistration suitability predetermined with regard to the suitabilitydetermination conditions and the guide UI guiding a registrable usercommand, on the screen thereof. Accordingly, the user may re-input orspeak a registrable user command with reference to the guide UIdisplayed on the screen of the display apparatus 100. Meanwhile, if itis determined that the registration for the user command is suitable,the display apparatus 100 outputs an audio for the user command. Afterthe audio for the user command described above is output, the displayapparatus 100 may perform the registration for the corresponding usercommand according to the following operations.

FIG. 10 is a flow chart of a method for registration of a user commandin a display apparatus according to an exemplary embodiment of thepresent disclosure.

As illustrated in FIG. 10, if it is determined that the registration forthe user command is suitable, the display apparatus 100 outputs theaudio for the user command (operation S1010). Thereafter, the displayapparatus 100 determines whether or not the spoken voice of the user isinput within a predetermined threshold time (operation S1020). As thedetermination result, if the spoken voice is input within thepredetermined threshold time, the display apparatus 100 registers theuser command according to a degree of similarity between the text forthe user command and the text for the input spoken voice (operationS1030 and operation S1040).

Specifically, if the spoken voice is input after the audio for the usercommand is output, the display apparatus 100 may convert the inputspoken voice into the text type or receive the voice recognition resultconverted into the text type from the voice recognition apparatus 300.Thereafter, the display apparatus 100 measures similarity between thephonetic symbols for the user command and the phonetic symbols for thespoken voice using the similarity algorithm such as the confusionmatrix, and requests a re-speaking if the similarity value according tothe measurement is less than the predetermined threshold value.Thereafter, if the spoken voice of the user is re-input, the displayapparatus 100 re-performs the above-mentioned operations (operationS1030 and operation S1040). If the similarity value measured between theuser command and the spoken voice by the above-mentioned re-performingis the predetermined threshold value or more, or is less than thepredetermined threshold value, the display apparatus 100 ends theoperation of performing the registration for the user command.Meanwhile, if the similarity value measured between the user command andthe spoken voice by the operation (operation S1040) is the predeterminedthreshold value or more, the display apparatus 100 registers and storesthe user command (operation S1050). After the user command defined bythe user is registered by the above-mentioned operations, the user maycontrol the operation of the display apparatus 100 by the spoken voiceassociated with the pre-registered user command.

In addition, the method for registration of a user command as describedabove may be implemented in at least one execution program for executingthe method for registration of a user command as described above, inwhich the execution program may be stored in a non-transitory computerreadable medium.

The method for registration of a user command of the display apparatusaccording to various exemplary embodiments described above may beimplemented in a program so as to be provided to the display apparatus.Particularly, the program including the method for registration of auser command of the display apparatus may be stored and provided in anon-transitory computer readable medium.

The non-transitory computer readable medium does not refer to a mediumstoring data for a short period such as a register, a cache, a memory,or the like, but refers to a machine-readable medium semi-permanentlystoring the data. Specifically, the programs described above may bestored and provided in the non-transitory computer readable medium suchas a compact disc (CD), a digital versatile disk (DVD), a hard disk, aBlu-ray disk, a universal serial bus (USB), a memory card, a read-onlymemory (ROM), or the like.

According to various exemplary embodiments of the present disclosure asdescribed above, the display apparatus may register the user command,which is resistant to misrecognition and guarantees the high recognitionrate, among the user commands defined by the user.

Hereinabove, the present disclosure has been described with reference tothe exemplary embodiments thereof.

Although the exemplary embodiments of the present disclosure have beendisclosed for illustrative purposes, those skilled in the art willappreciate that various modifications, additions and substitutions arepossible, without departing from the scope and spirit of the disclosureas disclosed in the accompanying claims. Accordingly, suchmodifications, additions and substitutions should also be understood tofall within the scope of the present disclosure.

What is claimed is:
 1. A non-transitory computer-readable recordingmedium storing instructions which, when executed by a processor of anelectronic device, cause the electronic device to perform operationscomprising: receiving a user voice; based on a user commandcorresponding to the user voice being already registered, controlling adisplay to display first information indicating that the user command isunable to be registered as a voice command; based on the user commandcorresponding to the user voice not being registered yet, controllingthe display to display second information indicating that the usercommand is able to be registered as a voice command; and based on theuser command corresponding to the user voice being related to aprohibited expression, controlling the display to display thirdinformation indicating that the user command is related to theprohibited expression.
 2. The non-transitory computer-readable recordingmedium of claim 1, wherein the operations further comprising: based onthe user command corresponding to the user voice being related to theprohibited expression, controlling the display to display informationfor guiding a registration of other voice command which is able to beregistered.
 3. The non-transitory computer-readable recording medium ofclaim 1, wherein the operations further comprising: based on the usercommand corresponding to the user voice being related the prohibitedexpression, controlling the display to display information for guiding are-input of other user voice.
 4. The non-transitory computer-readablerecording medium of claim 1, wherein the operations further comprising:based on the user command corresponding to the user voice being relatedthe prohibited expression, controlling the display to displayinformation including a text which is able to be registered, differentfrom the user command.
 5. The non-transitory computer-readable recordingmedium of claim 1, wherein the user command includes text informationcorresponding to the user voice, wherein the operations furthercomprising: controlling the display to display the text information; andbased on the displayed text information not being registered and notbeing related to the prohibited expression, registering the displayedtext information as a voice command.
 6. The non-transitorycomputer-readable recording medium of claim 1, wherein the user commandincludes text information corresponding to the user voice, wherein theoperations further comprising: controlling the display to display thetext information; and based on the displayed text information beingregistered or being related to the prohibited expression, notregistering the displayed text information as a voice command.
 7. Thenon-transitory computer-readable recording medium of claim 1, whereinthe operations further comprising: controlling the display to displaytext information corresponding to the user voice.
 8. The non-transitorycomputer-readable recording medium of claim 1, wherein the operationsfurther comprising: based on a plurality of text informationcorresponding to the received user voice being obtained, controlling thedisplay to display a list comprising the plurality of text information,and registering text information selected by a user input from among theplurality of text information as a voice command.
 9. The non-transitorycomputer-readable recording medium of claim 1, wherein the voice commandis a command for controlling an operation of the electronic device byregistering in the electronic device.
 10. The non-transitorycomputer-readable recording medium of claim 1, wherein the operationsfurther comprising: registering the user command corresponding to theuser voice according to a request for registering the voice command. 11.The non-transitory computer-readable recording medium of claim 1,wherein the operations further comprising: based on receiving a userinput through a user input receiver, entering a voice recognition modefor receiving the user voice through a user voice receiver, andregistering the user command corresponding to the user voice receivedthrough the user voice receiver as a voice command in the voicerecognition mode.
 12. A control mothed of an electronic device, themothed comprising: receiving a user voice; based on a user commandcorresponding to the user voice being already registered, controlling adisplay to display first information indicating that the user command isunable to be registered as a voice command; based on the user commandcorresponding to the user voice not being registered yet, controllingthe display to display second information indicating that the usercommand is able to be registered as a voice command; and based on theuser command corresponding to the user voice being related to aprohibited expression, controlling the display to display thirdinformation indicating that the user command is related to theprohibited expression.
 13. The control mothed of the electronic deviceof claim 11, wherein the method further comprising: based on the usercommand corresponding to the user voice being related to the prohibitedexpression, controlling the display to display information for guiding aregistration of other voice command which is able to be registered. 14.The control mothed of the electronic device of claim 11, wherein themethod further comprising: based on the user command corresponding tothe user voice being related the prohibited expression, controlling thedisplay to display information for guiding a re-input of other uservoice.
 15. The control mothed of the electronic device of claim 11,wherein the method further comprising: based on the user commandcorresponding to the user voice being related the prohibited expression,controlling the display to display information including a text which isable to be registered, different from the user command.
 16. The controlmothed of the electronic device of claim 11, wherein the user commandincludes text information corresponding to the user voice, wherein theoperations further comprising: controlling the display to display thetext information; and based on the displayed text information not beingregistered and not being related to the prohibited expression,registering the displayed text information as a voice command.
 17. Thecontrol mothed of the electronic device of claim 11, wherein the methodfurther comprising: controlling the display to display text informationcorresponding to the user voice.
 18. The control mothed of theelectronic device of claim 11, wherein the method further comprising:based on a plurality of text information corresponding to the receiveduser voice being obtained, controlling the display to display a listcomprising the plurality of text information, and registering textinformation selected by a user input from among the plurality of textinformation as a voice command.
 19. A non-transitory computer-readablerecording medium storing instructions which, when executed by aprocessor of an electronic device, cause the electronic device toperform operations comprising: receiving a user voice; based on the usercommand corresponding to the user voice being related to a prohibitedexpression, controlling the display to display first informationindicating that the user command is related to the prohibitedexpression; and based on the user command corresponding to the uservoice not being related to the prohibited expression, controlling thedisplay to display second information indicating that the user commandis able to be registered as a voice command.
 20. The non-transitorycomputer-readable recording medium of claim 19, wherein the operationsfurther comprising: based on the user command corresponding to the uservoice being related to the prohibited expression, controlling thedisplay to display text information which is different from textinformation corresponding the user command; and registering a usercommand corresponding to the displayed text information as the voicecommand according to a user input.